PRC PAKTUS: MUC-3 test results and analysis
نویسنده
چکیده
For natural language understanding researchers at PRC, preparing for MUC-3 was a usefu l endeavor in many respects . The value of having a well-defined task, a large corpus, and a n automated scoring program can hardly be overestimated . This exercise has pointed out the strengths of our system, confirmed our feelings about which aspects most need work, and taugh t us how to approach a task of this magnitude efficiently . In this paper, we will discuss our test results, the ways in which we prepared for the task, and lessons learned .
منابع مشابه
The PRC PAKTUS System: MUC-4 test results and analysis
In commenting on PRC's performance in MUC-3, we reported [1] that the component of ou r system that could most improve performance was discourse analysis . The MUC-4 exercise has strongly confirmed that view. We added a new discourse module to PAKTUS, made very fe w changes to the other system components, and the result was significantly improved performance . This paper discusses our test resu...
متن کاملPRC Inc.: description of the Paktus system used for MUC-4
BACKGROUND The PRC Adaptive Knowledge-based Text Understanding System (PAKTUS) has been unde r development as an Independent Research and Development project at PRC since 1984 . It includes a core English lexicon and grammar, a concept network, processes for applying these to lexical, syntactic, semantic, and discourse analysis, and tools that support the adaptation of the generi c core to new ...
متن کاملPRC Inc.: description of the PAKTUS system used for MUC-5
The PRC Adaptive Knowledge-based Text Understanding System (PAKTUS) was develope d as an Independent Research and Development project at PRC from 1984 through 1992 . It includes a core English lexicon and grammar, a concept network, processes for applying these to lexical , syntactic, semantic, and discourse analysis, and tools that support the adaptation of the generi c core to new domains, pr...
متن کاملPRC Inc.: description of the PAKTUS system used for MUC-3
The PRC Adaptive Knowledge-based Text Understanding System (PAKTUS) has been under development as a n Independent Research and Development project at PRC since 1984 . The objective is a generic system of tools , including a core English lexicon, grammar, and concept representations, for building natural language processin g (NLP) systems for text understanding. Systems built with PAKTUS are int...
متن کاملGE NLTooLSET: MUC-3 test results and analysis
This paper reports on the GE NLTooLsET customization effort for MUC-3, and analyzes th e results of the TST2 run . Although our own tests had shown steady improvement between TST1 and TST2, our official scores on TST2 were lower than on TST1 . The analysis of this unexpected result explains some of the details of the i1'UC-3 test, and we propose ways of looking at the score s . to distinguish d...
متن کامل